Resumen:
Hand gesture recognition and classification play a pivotal role in automating Human-Computer Interaction (HCI) and have garnered substantial attention in research. In this study, the focus is placed on the application of gesture recognition in surgical settings to provide valuable feedback during medical training. A tool gesture classification system based on Deep Learning (DL) techniques is proposed, specifically employing a Long Short Term Memory (LSTM)-based model with an attention mechanism. The research is structured in three key stages: data pre-processing to eliminate outliers and smooth trajectories, addressing noise from surgical instrument data acquisition; data augmentation to overcome data scarcity by generating new trajectories through controlled spatial transformations; and the implementation and evaluation of the DL-based classification strategy. The dataset used includes recordings from ten participants with varying surgical experience, covering three types of trajectories and involving both right and left arms. The proposed classifier, combined with the data augmentation strategy, is assessed for its effectiveness in classifying all acquired gestures. The performance of the proposed model is evaluated against other DL-based methodologies commonly employed in surgical gesture classification. The results indicate that the proposed approach outperforms these benchmark methods, achieving higher classification accuracy and robustness in distinguishing diverse surgical gestures.
Resumen divulgativo:
Este estudio se centra en el uso del reconocimiento de gestos en la formación quirúrgica, proponiendo una red neuronal LSTM con un modelo de atención. El enfoque, mejorado con aumento de datos, supera a otros métodos de Deep Learning en la clasificación de gestos quirúrgicos.
Palabras Clave: attention-based LSTM neural networks, data augmentation, deep learning, gestureclassification, surgical gestures
Índice de impacto JCR y cuartil WoS: 3,000 - Q2 (2023)
Referencia DOI:
https://doi.org/10.1111/exsy.13706
Publicado en papel: Diciembre 2024.
Publicado on-line: Septiembre 2024.
Cita:
S. Sorbet Santiago, J. Cifuentes, Deep learning-based gesture recognition for surgical applications: A data augmentation approach. Expert Systems. Vol. 41, nº. 12, pp. e13706-1 - e13706-21, Diciembre 2024. [Online: Septiembre 2024]
